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Probability and Discrete Probability Distribution 


PROBABILITY 


CHANCES Have you ever asked "what are the chances?”. 
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PROBABILITY The probability of any outcome of a random phenomenon is the 
proportion of times the outcome would occur in a very long series of 
repetitions. 

EXAMPLE In the very long run, the proportion of tosses that give a head is 0.5. 
This is the intuitive idea of probability. Probability 0.5 means “occurs 


half the time in a very large number of trials.” a z = 
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Useful Set Notation and Definitions 


PROBABILITY 


SET A set is a collection of objects (or elements). 
INTERSECTION The joint occurrence of two sets (the 
intersection) contains the common elements. 
Notation: For the intersection of two sets, A and B, 
we define AN B (sometimes, A and B). 


MUTUALLY EXCLUSIVE Two sets are mutually exclusive if the 
sets have no common elements. 

UNION The union of two sets, A and B, is another set 
which consists of allelements belonging to set A or 
to set B (or some may belong to both sets). 
Notation: AU B. 
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Intersection 


EXAMPLE: FIND THE PROBABILITIES? 


@ 40 were women (characteristic A) 

@ 30 individuals aged 30 or older (characteristic B) 

@ 20 were women aged 30 years or older (AN B). 

@ 50 unique individuals who had one or both characteristics (A U B) 
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Probability Axioms 


0 < P(A) <1. 
Sum of probabilities of all events is 1. 
O P(A)® = 1 — P(A). 
PERTY 4 For any two events A and B, P(AU B) = P(A) + P(B) — P(An B). 


A) PLE If 7% of the population smokes cigars, 28% of the population smokes 
cigarettes, and 5% of the population smokes both, what percentage 
of the population smokes neither cigars nor cigarettes? 
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Probability 


PROBABILITY OF EVENTS A AND B 


PROBABILITY CONCEPT 


Dependent Case 
Joint Probabilit 


Independent Case 


Addition 
P(A or B)= P(A)+P(B) 


Multiplication 
P(A and B)= P(A) * P(B) 


Addition 
P(A or B)= P(A)+P(B)-P(A and B) 


Multiplication 
P(A and B)= P(A) * P(B/A) 
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Probability 


CONDITIONAL PROBABILITY 


DEFN The conditional probability of an event B, given a second event A, is 
the probability of B happening, knowing that the event A has 
happened. 

NOTATION Conditional probability is denoted by P(B | A). 
EXAMPLE Conditional probabilities are used in life tables. 
@ B = a randomly chosen person from a population will live at 
least 65 years 
@ A = a randomly chosen person will live at least 60 years 
@ Then P(B | A) is the probability a person will live at least 65 
years, given that they have been selected from the population 
of people 60 years of age or older. 


o P(B| A) = Be. 
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Calculating Probability 


Patients with Disease X 


Age 
Gender Young Older Total 
Male 30 20 50 
Female 40 110 150 
Total 70 130 200 


P(Male) = 50/200 = 0.25 

P(Female) = 150/200 = 0.75 

P(Young) = 70/200 = 0.35 

P(Older) = 130/200 = 0.65 

Joint probability, P(Female and Older )= 110/200= 0.55 
P( Female or Older)=? (Ans: 0.85) 
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Conditional Probability 
AMPLE 2 
All the students in a certain high school were surveyed, then classified according to gender and whether they had 

either of their ears pierced: 

Pierced | Not Pierced 

Male 36 
Female | 288 
Total 
two categorical variables. 


Total 
144 180 
32 320 
324 176 500 
(Note that this is a two-way table of counts that was first introduced when we talked about the relationship between 
It is not surprising that we are using it again in this example, since we indeed have two categorical variables here: 
= Gender:M or F (in our notation, “not M”) 
= Pierced:Yes or No 
Suppose a student is selected at random from the school. 
= Let Mand not M denote the events of being male and female, respectively, 
= and Eand not E denote the events of having ears pierced or not, respectively. 
What is the probability that the student has either of their ears pierced? 
= P(E) = 324/500 = 0.648 


Since a student is chosen at random from the group of 500 students, out of which 324 are pierced, 
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Conditional Probability 


@ What is the probability that the student is male? (P(M) = 180/500 = 0.36). 


@ What is the probability that the student is male and has ear(s) pierced? (P(M and 
E) = 36/500 = 0.072). 


@ Given that the student that was chosen is male, what is the probability that he 
has one or both ears pierced? (P(E|M) = 36/180 = 0.20). 
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Conditional Probability 


EXAMPLE 3 


On the “Information for the Patient” label of a certain antidepressant, it is claimed that based on some clinical trials, 


a there is a 14% chance of experiencing sleeping problems known as insomnia (denote this event by I), 
= there is a 26% chance of experiencing headache (denote this event by H), 


a and there is a 5% chance of experiencing both side effects (I and H). 


(a) Suppose that the patient experiences insomnia; what is the probability that the patient will also 
experience headache? 


Since we know (or it is given) that the patient experienced insomnia, we are looking for P(H | I). 
According to the definition of conditional probability: 


= P(H 11) = P(H and I) / P(I) = 0.05/0.14 = 0.357. 


(b) Suppose the drug induces headache in a patient; what is the probability that it also induces insomnia? 


Here, we are given that the patient experienced headache, so we are looking for P(I | H). 


Using the definition 


= P(I I H) = P(I and H)/ P(H) = 0.05/0.26 = 0.1923. 


ihl 
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Probability 


SOME NOTES 


RANDOMNESS We call a phenomenon random if individual outcomes are uncertain 
but there is nonetheless a regular distribution of outcomes in a large 
number of repetitions. 

INDEPENDENT TRIALS The outcome of one trial must not influence the outcome of any 
other. 

IMPORTANT NOTE The idea of probability is empirical. Simulations start with given 
probabili- ties and imitate random behavior, but we can estimate a 
real-world probabil- ity only by actually observing many trials. 

EXERCISE You go to the doctor and she prescribes a medicine for an eye 
infection that you have. Suppose that the probability of a serious side 
effect from the medicine is 0.00001. Explain in simple terms what this 
number means. 
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Probability 


SOME NOTES 


RANDOM VARIABLE A random variable is a variable whose value is a numerical 
outcome of a random phenomenon. The probability distribution of a 
random variable X tells us what the possible values of X are and how 
probabilities are assigned to those values. 


DISCRETE RANDOM VARIABLE A discrete random variable has finitely many possible 
values. The probability distribution assigns each of these values a 
probability between 0 and 1 such that the sum of all the probabilities 
is exactly 1. The probability of any event is the sum of the 
probabilities of all the values that make up the event. 


CONTINUOUS RANDOM VARIABLE A continuous random variable takes all values in 
some interval of numbers. A density curve describes the probability 
distribution of a continuous random variable. The probability of any 
event is the area under the curve and above the values that make up 
the event. 
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Biostatistics 


DISCRETE PROBABILITY DISTRIBUTIONS 


EXAMPLE Hyponatremia (low sodium levels) occurs in a certain proportion of 
marathon runners. Now the question is, how many cases of 
hyponatremia are expected during the running of a particular 
marathon? 

What do you need to know to answer this question? 


@ Suppose there are 200 runners participating in a marathon (n = 
200). 

@ Suppose historically the proportion of runners who develop 
hyponatremia is assumed to be 0.12 (p = 0.12). 

@ Let X denote the number of these runners who develop 
hyponatremia. Then X follows binomial random variable. 
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Probability Distribution 


MEAN AND VARIANCE 


MEAN OR EXPECTATION, yx E(X) = X xf (Xj). or E(X) = fC, xf (x) dx. 
VARIANCE, o? V(X) = E[(x — E(X))?]. 
STANDARD DEVIATION SD is the square root of the estimated variance. 


RULES OF MEANS : 
@ If X is arandom variable and a and b are fixed numbers, then 


Hatbx = a+ bux 
@ If X and Y are random variables, then 
UX+Y = Lx + HY 


RULES OF VARIANCES Find out. 
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